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Description 

BACKGROUND 

5 [0001 ] The present invention relates generally to processing and displaying digital documents and, more particularly, 
to processing images in a raster image processor using transparency information. 

[0002] Digitally stored documents are often represented in an output-device independent language known as a page 
description language (PDL). Well known PDLs include the POSTSCRIPT language and the PORTABLE DOCUMENT 
FORMAT (PDF) language. Both POSTSCRIPT and PORTABLE DOCUMENT FORMAT are trademarks of Adobe Sys- 
w terns Incorporated, San Jose, California. In a PDL representation, a document may be described in terms of a list of 
instructions and resources. Instructions, for example, include commands to draw a line between two points or to fill a 
region with a specified color. Resources, for example, include images (raster representations of displayable objects), 
color spaces, and font specifications. 

[0003] The transparency of a graphical object indicates the extent to which an underlying object may be seen through 
is it. Here, the term object is used to denote any graphical entity such as an image, a font, or any other printable feature. 
In graphical processing, an object's transparency is implemented through a technique known as blending. Blending 
involves combining a foreground color, associated with a foreground graphical object, and a background color, associ- 
ated with a background graphical object, to create a third color. Blending can give an object the appearance of being 
translucent. 

20 [0004] In conventional graphical processing systems, blending generally is implemented in a special purpose appli- 
cation program executing on a general purpose computer In this environment, blending operations interrupt the execu- 
tion of the application program and consume the computer processor's time and memory resources. In addition, these 
special purpose applications are not typically capable of optimizing their output to a specific output device. 

25 SUMMARY 

[0005] Generally, the invention provides page description language extensions that allow blending operations to be 
performed within a raster image processor. These extensions include, but are not limited to, specification of a desired 
blending operation (e.g., normal, shadow, glow, darker, lighter, add, and overprint), a constant opacity parameter, and 

30 a position opacity parameter associated with an opacity data structure. 

[0006] Advantages of the invention include, but are not limited to, one or more of the following: conserves local com- 
puter resources by performing graphic object blending operations as part of the raster image processing process; 
graphical objects can remain device independent (e.g., with respect to resolution and color space) until final output is 
generated; and raster image processor blending allows users to obtain blended graphical output without modifying their 

35 graphical processing work flow. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0007] 

Figure 1 shows a schematic block diagram of a graphical processing system. 
Figure 2 illustrates blending foreground and background graphical objects. 
Figure 3 shows a POSTSCRIPT blend image data structure. 
Figure 4 shows a POSTSCRIPT blend data structure. 
45 Figure 5 shows some general blend functions. 

Figure 6 illustrates blend functions for the RGB and CMYK color spaces. 
Figure 7 shows a POSTSCRIPT opacity image data structure. 

Figure 8 illustrates some of the interdependencies between an opacity image's InterLeave key and the image's 
associated blend image. 
50 Figure 9 shows a PORTABLE DOCUMENT FORMAT blend image data structure. 
Figure 10 shows a PORTABLE DOCUMENT FORMAT blend data structure. 

Figure 1 1 illustrates blending a foreground object, which includes opacity information, and a background object. 
DETAILED DESCRIPTION 

55 

[0008] The following contemporaneously filed and commonly owned patent applications are incorporated by refer- 
ence: "Dehalftoning of Digital Images" by Stephen Carlsen et al., attorney docket no. 07844/087001 ; "Blending Graph- 
ics Objects In A Frame Buffer" by Stephen Carlsen, attorney docket no. 07844/229001; "Blending Image Data Using 
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Layers" by Stephen Carlsen et al., attorney docket no. 07844/231001; "Blending with Planar Maps" by Stephen N. 
Schiller et al., attorney docket no. 07844/228001; and "Conversion of Alpha-Multiplied Color Data by Lars Borg et al., 
attorney docket no. 07844/230001 . 

[0009] The invention may be embodied in any output display device that receives page description data and produces 
5 from that data output capable of being used to generate visual output, for example on a piece of paper. The invention 
has particular applicability to raster image processing (RIP) devices used within an graphical processing system and 
will be described in terms of an embodiment in such a device. RIPs may also be used in laser printers, dot matrix print- 
ers, ink-jet printers, plotters, image setters, digital presses, and the like. 

[0010] Referring to FIG. 1, an illustrative graphical processing system 100 includes a computer 105 and a raster 

w image processor (RIP) device 1 1 5. The computer 105 may be of any type, including a general purpose computer or a 
dedicated graphics workstation and usually transmits information to the RIP 1 15 in the form of a file 110 whose graph- 
ical contents are represented in a page description language (PDL). The interpreter 120 executes the PDL file's 110 
instructions and conveys the interpreted data to a renderer 125. The renderer 125 generates a raster based represen- 
tation (e.g., a bit stream) of its input. Renderer output may be sent to a standard (e.g., color or greyscale) printer 130, 

w an image setter 135, a display monitor 140, a storage device 145, or any other suitable output device 150. Common 
storage devices 145 include, but are not limited to, magnetic disks (fixed, floppy, and removable), other magnetic mate- 
rial such as tape, and optical medica such as CD-ROM disks. The interpreter 120 and renderer 125 may include mem- 
ory (1 55 and 1 60 respectively) which may be read only memory or random access memory or a combination thereof. 
[0011] The RIP 115 performs graphic object blending operations. As a result, computer 105 resources (e.g., time and 

20 memory) are not consumed by the blending operations, and output from the renderer 1 25 can easily be optimized for 
the specific output device. These results are possible because the PDL file 110 sent from the computer 105 to the RIP 
115 contains blending information. To accomplish this the chosen PDL must be extended, as described below, to 
include structures that incorporate blending information, and instructions that operate on this information. 
[0012] The terms below have the given meanings unless indicated otherwise. Additional definitions and standard 

25 nomenclature are given in the POSTSCRIPT Language Reference Manual, second edition published by Addison-Wes- 
ley Publishing Company (hereinafter the Reference Manual), the Supplement: PostScript Language Reference Manual, 
Language Level 3 Specification, version 3010 (hereinafter the Supplement) published by Adobe Systems Incorporated, 
and the Portable Document Format Reference Manual, version 1 .2 available from Adobe Systems Incorporated (here- 
inafter the PDF Reference Manual). 

30 

1 . Blend mode: The way in which two or more colors can be combined, see discussion below. 

2. Blending color space: The color space in which a foreground color and a background color are combined. 

3. Blending: The process of combining a foreground color and a background color to create a third color which can 
create the appearance of translucency. The resulting color is a function of the foreground color, the background 

as color, the blend mode, and the foreground object's opacity characteristics. This definition of blending explicitly 
excludes Boolean operations (e.g., exclusive-or) on bit data and is instead, directed at mathematical operations on 
multibitdata. 

4. Colorant or color component: Individual colorants (color components) in a painting scheme. For example, the 
red, green, blue (RGB) color space is comprised of three colorants. The cyan, magenta, yellow, and black (CMYK) 

40 color space is comprised of four colorants. 

5. Foreground, background, source, destination: The object to be printed is the source or foreground object. The 
output area which holds previously printed objects, such as a page raster buffer, is the destination or background. 

6. Matte color: A constant color towards which foreground colors can fade. 

7. Opacity: The degree of an object's opaqueness. A 0 value means the object is fully transparent, and a 1 value 
45 means the object is fully opaque. Opacity is also referred to as alpha (a). An opaque object always obscures any 

object already printed at the same location on a page, and thus an opaque object always appears to be in front of 
(overlie) previously printed objects. 

8. Opaque: The opposite of transparent. The color of a fully opaque foreground object is not blended with the back- 
ground. The resulting color when an opaque object is blended with a background is the color of the opaque object. 

so 9. Pre-multiplied alpha images: Images whose individual color values (C) have been previously multiplied by the 
image's opacity value: C = M + a(F - M) ; where F is the image's original (foreground) color, M is the image's matte 
color, and a is the color values' opacity value. 

[0013] Referring to FIG. 2, in general the process of blending takes a foreground object 200 having associated blend 
55 information, and a background object 205 and combines them in accordance with a specified blend function 210 to gen- 
erate a blended object 215. The foreground object 200 could, for example, be an image. Similarly, the background 
object 205 could be an image. The blended object 220 can be considered as a final object (e.g., image), or treated as 
the foreground or background object in a subsequent blending operation. A new image type, referred to as a "blend 
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image" is described below for the POSTSCRIPT and PDF languages that incorporates the necessary information to 
permit the rendering of non-opaque (transparent) images. 

[0014] Figure 3 shows an illustrative POSTSCRIPT language blend image data structure 300. The blend image data 
structure 300 extends the conventional POSTSCRIPT image object by including a blend parameter or key 305. 
s [001 5] Figure 4 shows a blend data structure 400 (also referred to as a blend dictionary) as referenced by the blend 
image's Blend key 305. Blending generally occurs in two stages and is controlled though the BlendMode 405 key of the 
blend data structure 400. In the first stage, the foreground image and background colors are combined in accordance 
with a specified blending function. In the second stage, the resulting color is multiplied by the foreground image's opac- 
ity. 

10 [001 6] A general formula for blending is: 

C = E + opacity x f(BlendMode, F, B); 

where C represents the resulting or blended color, B the background color, F the foreground color, and ffj one of a 

15 number of possible blend functions. The specific blend function chosen in any given instance will depend upon the cho- 
sen blend mode as identified by the BlendMode parameter 405 in the image's blend data structure 400. 
[0017] Referring to FIG. 5, an illustrative set of blend functions or modes 500 are defined. The variables C, F, B, W, 
and K represent values for each color component of the blending color space: C the resulting blended color value; F the 
foreground color value; B the background color value; W the color value for the color space's lightest color, e.g., white; 

so and K the color value for the color space's darkest color, e.g., black. The function DarkerQ returns the minimum of its 
input arguments if K is less than W, and the maximum of its input arguments if K is greater than or equal to W. The func- 
tion LighterQ returns the maximum of its input arguments if K is less than W, and the minimum of its input arguments if 
K is greater than or equal to W. While common values for W and K are 0 and 1 , essentially any value is possible. For 
example, in the XYZ color space W can be 0.95, 1 , or 1 .09 depending on the component. Values for F and B may be in 

25 the range [W ... K] or [K ... W], Each component in the blended color C is clipped to the range [W ... K] or [K ... W]. 
[0018] The normal blend mode 505 is a weighted average of the foreground and background colors. The shadow 
blend mode 510 simulates a shadow by scaling the background color towards dark proportional to the darkness and 
color of the foreground color. The glow blend mode 51 5 simulates a glow by scaling the background color towards light 
proportional to the lightness and color of the foreground color. The darker blend mode 520 selects the darker of the fore- 

30 ground and background colors. The lighter blend mode 525 selects the lighter of the foreground and background colors. 
The add blend mode 530 simulates two combined light sources by adding color intensities. The overprint blend mode 
535 simulates overprinting of two inks by adding ink color values. 

[001 9] Blend functions or modes, such as those shown in FIG. 5, can be defined for any color space where each color 
component increases monotonically from light to dark or from dark to light. Illustrative blend functions for the RGB and 
35 CMYK color spaces are defined in FIG. 6. (In FIG. 6, the Min() function returns the minimum of its parameters and the 
Max() function returns the maximum of its parameters.) 

[0020] As shown in FIG. 4, a blend image's opacity may be derived from two sources - a constant value 410 and a 
position-dependent value 41 5. Both opacities are optional and default to a value of 1 (opaque). The effective opacity at 
any position x, y within the image area is given by the product of these two opacities: 

40 

opacity[x, y] = ConstantOpacity x PositionOpacity[x, y]. 

The position-dependent opacity 41 5 takes its values from either an image or a pattern. The presence of PatternType or 
ImageType in a blend data structure's 400 PositionOpacity 415 parameter indicates one of these types of opacity infor- 
ms mation is present/available. 

[0021] As shown in FIG. 7, a POSTSCRIPT opacity image data structure 700 is a type of image data structure that 
has the same size, orientation, and placement in user space as its associated blend image 300. 
[0022] Opacity image data can be interleaved with its associated blend image (i.e., the foreground image) as specified 
in the opacity image data structure's 700 InterleaveType 705 parameter, If InterleaveType 705 is 1, interleaving is per- 
50 formed on a per pixel basis from a single data source in the foreground (blend) image. If InterleaveType 705 is 2, inter- 
leaving is performed on scanlines from a single data source in the foreground (blend) image. If InterleaveType 705 is 3, 
no interleave is performed and independent data sources for the opacity image and the foreground image are used. 
(For additional details on the parameter InterleaveType, see ImageType 3 as described in the Supplement.) Figure 8 
shows the interdependencies between an opacity image's InterleaveType 705 value and the opacity image's associated 
55 blend image (i.e., the foreground image). (Image parameters not shown in FIGs. 3 and 4, and cited in FIG. 8 are 
described in the Reference Manual.) 

[0023] If PositionOpacity 41 5 has the value 'PatternType' then the foreground (blend) image's opacity is determined 
by a pattern (as distinguished from an image) via a pattern dictionary. Pattern dictionaries are defined in the Reference 
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Manual and PDF Reference Manual. As defined in these references, the value of PatternType can be 1 (representing a 
tiled pattern) or 2 (representing a shading). 

[0024] For PatternType 1 , PaintType has a value of 1 (a colored pattern), and the pattern is tiled to cover the blended 
image area. Device pixels for which the pattern provides no color are transparent. If color spaces other than DeviceQray 
5 are used, the colors are implicitly converted to DeviceGray and the resulting gray color value is used as the opacity 
value where 0 (black) is transparent and 1 (white) is opaque. 

[0025] Referring to FIG. 9, a PDF blend image data structure 900 is represented as a modified image XObject. (See 
the PDF Reference Manual.) As with the POSTSCRIPT language's blend image data structure 300, an XObject blend 
image 900 contains descriptors for a blend data structure 905 that stores blend control information. Unless otherwise 
w noted, extensions (e.g., blending functions) to the PDF language are the same as those described above for the POST- 
SCRIPT language. 

[0026] A PDF blend image's opacity image data structure 1 000 is shown in FIG. 10. Unlike the POSTSCRIPT opacity 
image data structure 700, the PDF opacity image data structure's 1000 data is not interleaved with the PDF blend 
image 900. Further, the opacity image may not use the PDF defined Blend, ImageMask or Mask keys parameters. 

15 [0027] Blending a foreground object which may also have associated opacity information with a background object is 
illustrated in FIG. 1 1 . In a first step, foreground image data 1 1 00, foreground opacity data 1 1 05, and background data 
1 1 10 is subject to initial processing 1115. (As discussed earlier, opacity data 1 105 may or may not be present in any 
given blending operation.) Initial processing typically includes ensuring the image data 1 100 and background data 1110 
are in a common color space and that all three (image, opacity, and background data) are in a common representation 

so format, e.g., raster format. 

[0028] During the blend operation in step 2 1 1 20, foreground image and background colors are combined in accord- 
ance with the foreground image's specified blend mode (which identifies a specified blending function, see FIGs. 3 
through 7, 9 and 10). In practice, a blended color is calculated for each color component of each of the foreground 
image's color samples independently of the image's other color components. 

25 [0029] In step 3 1 1 25 postblend operations such as halftoning are performed. When complete, a new blended image 
1 1 30 is ready for output to a specified output device or storage. 

[0030] The present invention has been described in terms of specific embodiments, which are illustrative of the inven- 
tion and are not to he construed as limiting. Other embodiments than those described above are within the scope of the 
following claims. For example, the names of the defined structures' parameters and the order of performing steps of the 

30 invention may be changed by those skilled in the art and still achieve the desired results. In addition, blending opera- 
tions may take place in the RIP's output buffer or in a separate buffer. Further, other steps, common to image process- 
ing, such as decoding and interpolating may be implemented without departing from the invention. 
[0031 ] The invention may be implemented in digital electronic circuitry or in computer hardware, firmware, software, 
or in combinations of them. For example, the invention may be implemented, at least in part, as a computer program 

35 tangibly embodied in a machine-readable storage device for execution by a computer processor. Method steps accord- 
ing to the invention may be performed by a computer processor executing instructions organized, e.g., into program 
modules to operate on input data and to generate output. Storage devices suitable for tangibly embodying computer 
program instructions include all forms of non-volatile memory including, but not limited to: semiconductor memory 
devices such as EPROM, EEPROM, and flash devices; magnetic disks (fixed, floppy, and removable); other magnetic 

40 media such as tape; and optical media such as CD-ROM disks. Any of the foregoing may be supplemented by, or incor- 
porated in, specially-designed application-specific integrated circuits (ASICS). Other embodiments than those 
described above are within the scope of the following claims. 

Claims 

45 

1. A page description language data structure stored in memory, the data structure associated with one or more 
objects defined in the page description language, the data structure comprising a blend parameter indicating a 
blend data structure. 

so 2. The data structure of claim 1 wherein the blend data structure comprises: 

a blend mode parameter for indicating a specified blend mode; 
a constant opacity parameter; and 

a position opacity parameter for indicating an opacity data structure. 

55 

3. The data structure of claim 1 wherein the page description language is the POSTSCRIPT language. 

4. The data structure of claim 1 wherein the page description language is the PORTABLE DOCUMENT FORMAT lan- 
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guage. 

5. A program storage device readable by a computer system, the program storage device having encoded therein a 
program of instructions that includes instructions to define a page description language data structure having a 

5 blend parameter, the blend parameter further indicating a constant opacity parameter and a position opacity 
parameter. 

6. A graphical processing system comprising: 

10 a computer; and 

a raster image processor adapted to 

receive a page description language representation of graphical image data from the computer, the graphic 
image data having blending information, and 

generate a blended image based on the graphic image data blending information. 

15 

7. The graphical processing system of claim 6 wherein the blending information comprises a blend parameter indicat- 
ing a blend data structure. 

8. The graphical processing system of claim 7 wherein the blend data structure further comprises an opacity data 
20 structure. 

9. The graphical processing system of claim 6 further comprising a print device for outputting the blended image. 

10. The graphical processing system of claim 6 wherein the graphical image data is contained within the received page 
25 description language representation. 

11. The graphical processing system of claim 6 wherein the graphical image data is not contained within the received 
page description language representation. 

30 12. The graphical processing system of claim 9 wherein the print device is a color printer. 

13. The graphical processing system of claim 9 wherein the print device is an image setter. 

14. The graphical processing system of claim 9 wherein the print device is a storage device. 

35 

15. A raster image processor comprising: 

an interpreter adapted to 

receive graphic image data represented in a page description language and having a blend parameter indicat- 
40 ing a blend data structure, said blend data structure comprising blending information, and 

generate a blended image based on the blending information; and 
a renderer adapted to receive the blended image data from the interpreter. 

16. The raster image processor of claim 15 wherein the blending information comprises a blend parameter indicating 
45 a blend data structure. 

17. The raster image processor of claim 16 wherein the blend data structure further comprises an opacity data struc- 
ture. 

so 1 8. The raster image processor of claim 1 5 further comprising a print device for outputting the blended image. 

19. The raster image processor of claim 1 8 wherein the print device is a color printer. 

20. The raster image processor of claim 1 8 wherein the print device is an image setter. 

55 

21 . The raster image processor of claim 1 8 wherein the print device is a storage device. 
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